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This  document  contains  information  affecting  the  National 
Defense  of  the  United  States  within  the  meaning  of  the  Espio- 
nage Laws,  Title  18,  U.  S.  C.,  Sections  793  and  794.  Its  trans- 
mission or  the  revelation  of  its  contents  in  any  manner  to  an  un- 
authorized person  is  prohibited  by  law. 


ABSTRACT 


Differences  are  brought  out  between  guided-missile  refraction  geometry  and  astronomical 
refraction  geometry.  A simple  relationship  between  angular  refraction  of  light,  refraction 
error  for  ground  observer,  and  refraction  error  for  aerial  observer  is  demonstrated.  While 
angular  refraction  of  light  depends  only  on  the  extent  of  appreciable  density  of  the  atmos- 
phere, the  two  types  of  refraction  error  continue  to  vary  beyond  this  point,  due  to  geometry. 

Basic  equations  for  atmospheric  refractive  index,  angular  refraction,  and  refraction  errors 
for  ground  and  aerial  obser  vers  are  derived  from  physical  principles,  without  resort  to  em- 
pirical equations  or  graphical  integration.  Previously  available  equations  for  angular  re- 
fraction and  refraction  errors  were  applicable  only  to  altitudes  of  less  than  J J miles  or 
only  to  infinite  altitudes.  Present  equations  hold- for  any  altitude.  Methods  of  this  report 
are  capab'e  of  application  to  any  atmospheric  temperature  profile. 
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I. 


INTRODUCTION^ 


This  report  makes  available  part  of  the  basic  work  which  is  being  done  by  the  Flight  De- 
termination Laboratory  on  atmospheric  refraction  errors  in  the  instrumentation  of  guided 
missiles.^  A comprehensive  study  of  atmospheric  refraction  errors  for  optical  instrumen- 
tation, based  on  a flat  earth  assumption,  will  be  published  subsequently. 


II.  VALIDITY  OF  FLAT  EARTH  ASSUMPTION  FOR  ATMOSPHERIC  CALCULATIONS 


The  relative  mass  of  the  atmosphere  at  any  elevation  angle  is  given  approximately  by  the 
cosecant  of  the  elevation  angle.  This  relationship  is  correct  for  a flat  earth  and  a flat 
atmosphere.^) 


To  obtain  an  approximate  measure  of  the  accuracy  of  the  above  flat  earth  relationship,  it 
was  compared  with  results  obtained  by  a spherical  earth  equation.  Duntley  (Ref.  1)  gives 
an  equation  for  relative  number  of  molecules  per  unit  volume  at  any  altitude,  which  can  be 
rewritten  in  terms  of  relative  density  :3) 
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y 

4.11 


( 1) 
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p = density  of  atmosphere  at  altitude  y 

Po  = density  of  atmosphere  at  ground  level 
y - altitude  above  ground  level  (in  miles) 

The  same  equation  in  terms  of  slant  range  (for  a spherical  earth)  wculd  be:^) 
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1)  Most  oj  we  material  in  tie  present  report  was  published  for  local  distribution  at  WSPG  on  2 February  1953. 

2)  In  tie  present  comparison  of  tie  relative  air  masses  at  various  elevation  angles  for  flat  and  spheric^  earths, 
no  account  is  taken  of  tbs  slightly  curved  path  followed  by  radiation  arriving  at  a given  angle • 

3)  Actually,  an  equation  of  this  form  is  correct  only  for  an  isothermal  atmosphere. 

4)  Derivation  will  he  given  in  a subsequent  report. 
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rc  = radius  of  earth  to  ground  level  (in  miles) 

I = slant  range  from  ground  level  (in  miles) 

E = elevation  angle 

f- 

The  total  integral  of  p with  respect  to  l,  for  a given  value  of  E,  is  a measure  of  the  total 

/ 

air  mass  at  elevation  angle  E.  Graphical  integrations  were  carried  out  for  several  values 
of  E,  using  equation  (2).  The  resulting  totals  were  divided  by  the  vertical  "air  mass" 
obtained  as  the  integral  (from  0 to  of  p with  respect  to  y,  using  equation  (1).  Figure  1 
shows  a comparison  of  the  relative  air  masses  at  various  elevation  angles  for  flat  and 
spherical  earths.  The  following  table  gives  the  percentage  deviation  of  the  flat  earth  equa- 
tion from  the  spherical  earth  equation  at  low  elevation  angles : 


Elevation  angle 
% deviation  of 

:o° 

_2 L 

_21 

7° 

_6L. 

_5L 

-JL 

flat  earth  equation 

2.0 

2.4 

3.0 

3.9 

6.9 

11.8 

18.7 

Where  5%  accuracy  is  sufficient,  it  appears  that  a flat  earth  assumption  may  be  safely  used 
down  to  about  7°  elevation,  for  those  atmospheric  parameters  which  have  a linear  depend- 
ence on  intervening  air  mass. 

ffl.  VARIATION  OF  REFRACTION  PARAMETERS  WITH  ALTITUDE 
A.  Pressure 


A linear  decrease  in  temperature  with  altitude  is  characteristic  of  the  troposphere  as  a 
whole.  For  this  region  the  relationship  between  pressure  and  altitude  may  be  written 
(Ref.  2): 


* " ~ nr/** 

p = pressure  at  altitude  y 
Po  = pressure  at  ground  level 
L * vertical  temperature  gradient,  AT/Ay 
R = gas  constant  for  air,  p/gpT  or  P0/gp0T0 
T = absolute  temperature  at  ground  level 

O 

g = acceleration  of  gravity 
T = absolute  temperate . e at  altitude  y 


B.  Density 


Since 


P.  T 


and 


T = T + Ly 


P_ 

Pc 
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C.  Refractive  Index 


If  the  refractive  index  of  air  at  ground  level  is : 


n = 1 + a, 

O O 


the  refractive  index  at  any  altitude  may  be  expressed  as:*^ 


n = 1 + a 


For  the  troposphere : 


n = 1 

5)  Proof  will  it  fivtn  in  a tubttqunl  ttpori. 
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D.  Angular  Refraction  of  Light 


Fof  t Uat  earth,  it  can  be  shown  from  Snell's  law  that : (Ref.  3) 

cos  E __  no 

cos  r n 
o 

" 5=  elevation  angle  (duection)  of  light  ray  at  altitude  y 
Eq=  observed  elevation  angle  of  same  light  ray  at  ground  level 

Equation  (7)  may  also  be  written : 


cos(eo  - A.  r)  = _JL 
cos  E_ 


n 


A.R.  = angular  refraction  of  light  ray  between  y and  ground  level 
From  equation  (8)  it  is  easily  shown  that 


A.R.  = n°  n cot  E where  A.  R.  is  in  radians 
n ° 


For  practical  purposes 


or 


A.  R. 


A.  R.  = ^no  - n)  cot  Eo 
= (l  + ao  - 1 - = ao(j  - 


Icot  E 


For  the  troposphere  : 


A.  R.  = a. 


- I 


cot  E_ 


It  should  be  noted  that  this  equation  gives  angular  refraction  in  radians. 


6)  Sinct  n is  tferally  Uss  than  1,000 ) for  optic*  frequencies,  the  error  in  this  epproxitutttou  sPUt  bo  lent 
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Although  equation  (9)  was  derived  for  the  troposphere,  it  may  be  extrapolated  to  any  al- 
titude. Using  the  National  Advisory  Committee  for  Aeronautics  standard  atmosphere  (Ref. 
2)  as  a working  model,  checks  have  been  made  through  the  isothermal  layer  above  the  tro- 
posphere, and  through  the  next  layer,  which  ife  characterized  by  a linear  increase  in  temp- 
erature with  altitude."^  The  maximum  deviation  of  the  extrapolated  troposphere  equation 
from  the  complete  equation  was  1.7%.  The  relative-density  term  in  the  troposphere  equat- 
ion goes  to  zero  at  a definite  height.®)  Above  this  height  it  is  necessary  to  use  zero  for 
the  density  term,  and  equation  (9)  then  reduces  to  the  well-known  astronomical  equation 
for  total  angular  refraction  over  a flat  earth : 


A.  R.  = a cotE 

O O 


or 


A.  R.  = a 


cos  E, 

C 

sin  E_ 


At  low  elevation  angles,  the  total  angular  refraction  will  be  an  approximately  linear  funct- 
ion of  1/ sin  Eo,  or  air  mass.  A flat  earth  assumption,  then,  may  be  safely  used  for  total 
angular  refraction  down  to  about  7°  elevation.  It  would  appear  that  the  same  rule  may  be 
safely  applied  to  partial  angular  refrarcion  (equation  (9)). 


E.  Refraction  Error  for  Ground  Observer 


Figure  2A  represents  the  geometry  of  the  refraction  problem  for  a guided  missile,  or  other 
object  in  the  vicinity  of  the  earth.  Light  from  a point  on  the  missile  (M)  starts  toward  the 
gioi  nd  along  the  line  which  forms  elevation  anqle  E with  the  horizontal.  It  follows  an  in- 
creasingly curved  path  and  arrives  at  camera  C at  observed  elevation  angle  Eo.  The  differ- 
ence between  the  initial  ana  final  directions  is  the  angular  refraction  (A.R.).  The  differ- 
ence between  the  final  and  true  directions  is  the  refraction  error  (R.E.)  for  the  ground 
observer  at  C.  The  difference  between  the  initial  and  true  directions  is  the  refraction  error 
(R.E.')  for  an  observer  (or  camera)  in  the  missile  looking  at  the  ground  target  (C). 

Obviously,  A.  R.  = R.  E.  + R.  d.  ( 10  ) 


T)  The  equation  used  to  calculate  angular  refraction,  accurately,  through  several  regions  of  the  atmosphere 


will  be  given  in  a subsequent  report. 

8)  For  NACA  standard-atmosphere  data,  the  relative-density  term 
145,310  ft,  (above  sea  level), 

5 


-i 
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Figure  2B  represents  astronomical  refraction  geometry,  where  the  object  (0)  is  effectively 
at  an  infinite  distance  from  the  earth.  Under  these  conditions,  rays  from  0 arriving  at  the 
earth's  atmosphere  are  effectively  parallel  to  the  true  direction.  The  (angular)  refraction 
error  for  an  observer  at  0 would  be  zero,  and  A.R.  becomes  equal  to  R.E.  In  observation- 
al work  on  stars  or  planets,  the  angular  refraction  of  light  in  the  earth's  atmosphere  is 
synonymous  with  the  refraction  error  (or  refraction  correction). 


To  calculate  refraction  errors  for  guided  missile  work,  it  is  necessary  to  introduce  a hori- 
zontal coordinate  x,  which  is  defined  in  this  report  as  horizontal  range.  Corum  (Appendix 
to  Ref.  3)  gives  a flat  earth  equation  from  which  the  (angular)  refraction  error  for  a ground 
observer  may  be  evaluated 


r 


X = 


n cos  E 
a n_ 


*1/  n2  — n2  cos2  E 


dy 


For  a given  value  of  x,  the  corresponding  corrected  value  of  y can  be  obtained  by  solution 
of  equation  (11).  Then  : R.E.  = Eq  - arc  tan  _ Terman  (Ref.  4)  gives  essentially 
equation  (11)  for  radio-frequency  propagation  ii  the  ionosphere,  with  derivation  references 
dating  back  to  1926. 

Mallinckrodt  (Ref.  5)  has  published  a corresponding  solution 


= y cot  E + 


cot  Eo 
sin2  E 


v - v 


dy 
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v = velocity  of  propagation  of  radiation  at  altitude  y 
vo  = velocity  of  propagation  at  ground  level 
Equation  ( 12)  may  also  be  written  :^) 


For  refractive  indices  very  close  to  unity,  it  can  be  shown  that  equations  (11)  and  (13)  are 
approximate  identities.  Mallinckrodt's  equation  reduces  the  work  of  integration  and  has 
the  advantage  of  being  in  the  form  : x = cot  EQ(y  + Ay).  Equation  (13)  may  be  simpli- 
fied to  : ^ 


f y 


cot  E 

x = y cot  E + ° 


sm 


2 E 


dy 


(14) 


The  function  n — n was  evaluated  for  the  troposphere  in  equation  (9).  Substituting  this 


term  in  equation  (14) : 

a cot  E, 


x = v cot  E + 2 ■ 

° sinl 2  E_ 


l 


1 


-4+ y 


_ i 


LR 


dy 


( 15) 


Integration  gives  :^) 


a cot  E . „„ 

x = y cot  E + ° _ „ _ ° 4 y + 


° sin2  E 


C1  +TY) 


LR 


(16) 


It  can  be  shown  geometrically  that 


l 


H - 


Ay  cos  E„  or  R.  E.  = 


cos  Eq  Ay 


l = slant  range 

Ay  = apparent  y minus  true  y 


10)  Tbe  error  in  the  function  ~ n in  coveted  by  footnote  6).  Tbe  error  in  tbe  integral  uiUt  be  discussed 
later  in  this  section,  n 


Substituting  for  Ay  from  equation  ( 16)  : 


cos  c.  a ) 
R.  E.  = 2. 2_  Jy 

l sin5  E | 


r l -- 

♦ RT0  +-rv^  “ -l  j. 


Since  l sinEQ  is  approximately  equal  to  y : 


a cos  E \ 

R.  E.  = -5 2-<y 

y sin  E 1 


+ RT{('  *Xy)  " 

j1  * v{('  4')'” 


If  roughly  approximate  values  of  x and  y are  obtained  in  the  first  step  of  a reduction  of  tra- 
jectory data,  the  angular  refraction  error  is  given  by  : 


R.E.  - ao_ 


’(*  * 


It  should  be  noted  that  equations  (17)  and  (18)  give  refraction  error  in  radians. 


Although  equations  ( 17)  and  ( 18)  were  derived  for  the  troposphere,  either  one  may  be  used, 
practically,  for  any  altitude.  Using  the  NACA  standard  atmosphere  (Ref.  2)  as  a working 
model,  checks  have  been  made  through  all  (nine)  regions  of  the  standard  atmosphere. 


ll)  The  equation  used to  calculate  rt fraction  error,  accurately,  through  all  region*  of  the  NACA  standard  at* 
m> sphere  will  be  given  in  a subsequent  report,  NACA  data  for  tie  troposphere  are  as  follows: 

To  = <18.4  °Rankiue  L =-..003566  °F/fU 

Height  of  troposphere  : (to)  35,332  ft.  above  sea  level 
Value  of  R taken  as  53.3583  fW°P 

Value  of  a taken  as  0.0002728  from  value  given  by  Epstein  (Ref.  7).  A better  choice  for  optical  frequencies 
o 

would  have  been  0.0002762  from  value  given  hy  Sears  (Ref,  8). 


ms 


fyy* 
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Table  I and  Figure  3 show  a comparison  of  the  FDL  complete  equation,  an  empirical  equa- 
tion published  by  Mallinckrodt  (Ref.  6),  and  the  above  single-region  equations.  Refraction 
error  was  calculated  by  each  equation  for  a series  of  altitudes  (and  several  angles).  Of  the 

troposphere  equations,  (16)  was  actually  used  together  with  : R.E.  = E - arc  tan  JL. 

° x 


Most  of  the  deviation  of  the  Mallinckrodt  equation,  within  the  tropospnere,  is  due  to  the 
difference  between  Cocoa,  Florida  mean  annual  temperature  (21.2°C)  and  NACA  standard 
temperature  (15°C).^  It  may  be  seen  that  Mallinckrodt's  empirical  equation  is  accurate 
only  for  the  troposphere  and  becomes  unusable  above  about  70,000  feet. 


The  small  deviation  of  equation  ( 16)  in  the  troposphere  is  due  to  simplifying  — 2_ to  nft  — n 

(within  the  integral  term).  Equation  (16)  shows  a deviation  approaching  1%  in  the  isothermal 
region  above  the  troposphere,  but  this  deviation  decreases  at  higher  altitudes.  The  pressure 
term  in  equations  (16),  (17)  and  (18)  goes  to  zero  at  a definite  height.  Above  this  height 
it  is  necessary  to  use  zero  for  the  pressure  term.  In  Figure  3,  the  curve  for  the  single-region 
equation  is  drawn  to  show  what  happens  if  the  real  part  of  the  complex  number,  which  develops 
above  this  height,  is  used  instead  of  zero. 


The  angular  refraction  of  light  varies  o..iy  within -the  extent  of  appreciable  density  of  the 
atmosphere.  The  refraction  error  for  a ground  observer  continues  to  vary  beyond  this  point, 
due  to  the  purely  geometric  factor  of  vertical  distance.  In  equation  (17),  R.E.  does  not  be- 
come equal  to  total  A.R.  until  y is  infinite. 


If  y is  fixed  at  the  value  where  the  pressure  term  becomes  zero,  equation  ( 17)  becomes  : 


R.  E. 


a cot  E 

O O 


or 


R.  E. 


a 

o 


cos  E f 

— V1 

sin  E ' 

O 


) 
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12)  A companion  based  on  Cocoa,  Florida  data  will  be  give*  in  a subsequent  report* 


If  range  is  now  increased  t«  maintain  this  same  value  of  y as  the  elevation  angle  is  de- 
creased, the  refraction  error  wall  be  an  approximately  linear  function  of  1/sin  Eo1or  air  mass. 

For  very  long  ranges,  then,  the  flat  earth  assumption  may  be  safely  used  for  angular  refrac- 
tion error  down  to  about  7°  elevation.  It  would  appear  that  the  same  rule  may  be  safely 
applied  for  ordinary  ranges. 

Where  the  lower  regions  of  the  troposphere  show  an  irregular  temperature  profile,  it  may  be 
desirable  to  break  up  the  troposphere  into  a series  of  regions  with  different  temperature 
gradients  (either  positive  or  negative).  The  integral  term  in  equation  ( 15)  then  becomes  a 
series  of  similar  integrals.  ^ 

F.  Refraction  Error  for  Aerial  Observer 

From  equation  ( 10)  : 

R.  E.  = A.  R.  — R.  E.  ( 19  ) 


Substituting  equations  (9)  and  (17)  in  equation  (19)  and  collecting  terms  : 


It  should  be  noted  that  equation  (20)  gives  refraction  error  for  an  aerial  observer  in  radians. 


From  previous  considerations,  equation  (20)  may  be  used  for  any  altitude  and  may  be  safely 
used  down  to  about  7°  elevation. 


14)  Tb*  us*  of  tie  about  refraction-error  equations  to  fit  any  lemperatur*  profit*  of  a stationary  atmospbtr* 
(including  possible  isothermal  regions)  will  be  covered  in  detail  in  a subsequent  report. 
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Figure  2A.  Refraction  Geometry  for  Guided  Missile 


Figure  2B.  Astronomical  Refaction  Geometry 
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